WHAT IS CLAIMED IS: 

1. An obstacle detection system comprising: 

a plurality of TV cameras for inputting multiple images; 

an image storage unit for storing a plurality of images 
inputted from said TV cameras; 

a feature extraction unit for extracting lines existing 
on a plane in a three-dimensional space ^ from the images; 

a parameter computation unit for determining a relation 
to hold between the projected positions of an arbitrary point 
on said plane upon the individual images,, from the lines 
extracted by said feature extraction unit; and 

a detection unit for detecting a region absent from said 
plane, by using the relation computed by said parameter 
computation unit. 

2. An obstacle detection system according to Claim 1, 
wherein said TV cameras are unknown on their relative 

positions and orientations and on their focal lengths and 
principal points. 

3» An obstacle detection system according to Claim 1 or 2, 
wherein the relation to hold between the projected points 
of an arbitrary point on the plane in the three-dimensional 
space upon the individual images is expressed by a 
two-dimensional af f ine transformation thereby to determine the 



# • 

affine transformation parameters. 

4. An obstacle detection system according to any of Claims 
1 to 3, 

wherein said feature extraction unit extracts a plurality 
of lines, as existing on the plane in the three-dimensional 
space and parallel to each other in the three-dimensional space, 
from the images, and determines the vanishing points of said 
lines . 

5. An obstacle detection system according to any of Claims 
1 to 3, 

wherein said feature extraction unit extracts a plurality 
of lines, as existing on the plane in the three-dimensional 
space and parallel to each other in the three-dimensional space, 
from the images, and determines the inclinations of said lines 
on the images and the vanishing points of said lines. 

6. An obstacle detection system comprising: 

a plurality of image pickup units having light receiving 
units disposed on a driver ' s own vehicle at a substantial spacing 
from each other for taking the regions, to which the light 
receiving units are directed, simultaneously as images; 

an image storage unit for storing the images taken by 
said image pickup units; 
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a feature extraction unit for extracting such ones of 
the regions taken by said image pickup units as correspond to 
parallel members disposed generally in parallel with each other 
on a plane, as can be traveled by said own vehicle, from the 
first image taken by said first image pickup unit and the second 
image taken by said second image pickup unit, as stored in said 
image storage unit, to determine intersection points at which 
said extracted regions intersect in said first and second images ; 

a difference detection unit for determining the 
corresponding region in the second image, as corresponding to 
an arbitrary region in said first image, assuming that said 
arbitrary region is arising from said plane, from the epipolar 
constraint to hold between said extracted region and said first 
and second images, to compare the intensities of said arbitrary 
region and said corresponding region, thereby to extract the 
region having a substantially different intensity as an obstacle 
region to obtain an obstacle region image from the extracted 
result; and 

a height computation unit for extracting a polygonal 
region, as composed of an intensity higher than a standard value, 
of said obstacle region image thereby to detect as a true obstacle 
region said polygonal region of a threshold or higher value 
of the ratio which is determined from the vertical size of said 
polygonal region in said obstacle region image and the size 
from the lower end of said polygonal region to the scan-line 



in said obstacle region image including said intersection point . 

7. An obstacle detection system comprising: 

a plurality of image pickup units having light receiving 
units disposed at a substantial spacing from each other for 
taking the regions, to which the light receiving units are 
directed, simultaneously as images; 

an image storage unit for storing the images taken by 
said image pickup units; 

a difference detection unit for determining the 
corresponding region in the second image, as corresponding to 
an arbitrary region in said first image, assuming that said 
arbitrary region is arising from a plane in a three-dimensional 
space, to compare the intensities of said arbitrary region and 
said corresponding region, thereby to extract the region having 
a substantially different intensity as an obstacle region to 
obtain an obstacle region image from the extracted result; and 

a height computation unit for extracting a polygonal 
region , as composed of an intens ity higher than a standard value , 
of said obstacle region image thereby to detect as a true obstacle 
region said polygonal region of a threshold or higher value 
of the ratio which is determined from the vertical size of said 
polygonal region in said obstacle region image and the size 
from the lower end of said polygonal region to the scan-line 
set in said obstacle region image. 



8, An obstacle detection system comprising: 

a first image pickup unit and a second image pickup unit 
for obtaining a first image information of a first image and 
a second image information of a second image, respectively, 
by taking the surrounding region of a driver's own vehicle 
substantially simultaneously as images formed of a set of pixels 
from light receiving units arranged at a spacing on the own 
vehicle; 

an image information storage unit for storing said first 
image information and said second image information; 

an intensity difference image forming unit for forming 
an intensity difference image by determining the corresponding 
pixels in said second image of the second image information, 
as assuming that an arbitrary pixel of said first image of said 
first image information stored in said image information storage 
unit exists on the ground plane being traveled by said own vehicle , 
to determine the intensity difference between said arbitrary 
pixel and said corresponding pixel; 

a discrimination image forming unit for obtaining a 
discrimination image by discriminating each pixel in said 
intensity difference image into a pixel having an intensity 
difference no less than a standard value and a pixel having 
an intensity difference less than the standard value; and 

a decision unit for detecting and deciding a region having 





a generally wedge-shaped set of pixels in said discrimination 



image as an obstacle region. 



9. 



An obstacle detection system according to Claim 8, 



wherein said detection unit decides that the lowermost 
pixel in said wedge-shaped region of said discrimination image 
is either at a point of contact between said obstacle region 
in said first or second image, as corresponding to said 
discrimination image, and the ground being traveled by said 
own vehicle, or at a portion of said obstacle region and the 
closest to said own vehicle. 

10. An obstacle detection system according to Claim 8 or 9, 
wherein said detection unit decides that such one of said 

generally wedge-shaped region existing generally in the 
scan-line direction of said first and second images, as 
corresponding to said discrimination image, that its side is 
at a higher location of said first and second images than the 
apexes opposed thereto, is the obstacle region. 

11. An obstacle detection system according to Claim 8, 
wherein said detection unit decides one pair of 

wedge-shaped regions generally of the same shape, as located 
at a spacing on the- generally identical scan-line in said 
discrimination image, and decides the region between said paired 




wedge-shaped regions as the obstacle. 

12* An obstacle detection system comprising: 

an image input unit for inputting and storing at least 
two images of different pickup points; 

a feature extraction unit for extracting a projected point 
of a motion of an object, as stands still or moves on a plane 
in a three-dijnensional space with respect to the pickup point 
of a standard image/ upon said standard image corresponding 
to an infinite point, by employing one of the images stored 
by said image input unit as said standard image and the other 
as a reference image; 

a detection unit for calculating a corresponding point 
on said reference image when it is assumed that an arbitrary 
point on said standard image is on said plane, to detect a point 
non-existing on said plane from the intensity difference between 
said arbitrary point and said corresponding point; and 

a contact time computing unit for computing the time period 
for the point non-existing on said plane to come to the taken 
point of said standard image, on the basis of the point 
non-existing on said plane in said standard image detected by 
said detection unit and said projected point extracted from 
said feature extraction unit- 

13. An obstacle detection system according to Claim 12, 
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wherein said contact time computation unit computes the 
time period for the point on the boundary with said plane to 
come to the taken point of said standard image, on the basis 
of such ones of the points detected by said detection unit but 
not existing on said plane, as are located on the boundary line 
with said plane in said standard image and are extracted as 
said projected point by said feature extraction unit. 

14. An obstacle detection system according to Claim 12 or 
13, 

wherein said feature extraction unit extracts a plurality 
of lines aligned to the direction of the motion of an object 
which stands still or moves on said plane relative to the pickup 
point of said standard image, to employ the point of intersection 
of the extracted lines, as said projected point. 

15. An obstacle detection system according to any Claims 12 
to 14, 

wherein said images are unknown on the relative positions 
and orientations of their pickup points and on their focal 
lengths and principal points. 

16. An obstacle detection system according to any of Claims 
12 to 15, 

wherein said detection unit computes the corresponding 
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point on said reference image when the arbitrary point on said 
standard image is assumed to be on said plane, to detect said 
non-existing point from a similarity of the surrounding 
intensities of said arbitrary point and said corresponding 
point, 

17. An obstacle detection method comprising: 

an image storage step of storing a plurality of images 
inputted from a plurality of TV cameras; 

a feature extraction step of extracting a line existing 
in a plane of a three-dimensional space, from the images; 

a parameter computation step of determining a relation 
to hold between the projected positions of an arbitrary point 
in said plane upon the individual images , from the line extracted 
at said feature extraction step; and 

a detection step of detecting a region absent from said 
plane, by using the relation computed at said parameter 
computation step* 

18. An obstacle detection method according to Claim 17, 
wherein said TV cameras are unknown on their relative 

locations and positions and on their focal lengths and principal 
points . 

19. An obstacle detection method according to Claim 17 or 



18, 

wherein said parameter computation step expresses the 
relation to hold between the projected points of an arbitrary 
point of the plane in the three-dimensional space upon the 
individual images by a two-dimensional affine transformation 
thereby to determine the affine transformation parameters. 



^ ^ 20. An obstacle detection method according to any of Claims 
17 to 19, 

wherein said feature extraction step extracts a plurality 
of lines, as existing on the plane in the three-dimensional 
space and parallel to each other in the three-dimensional space, 
from the images, and determines the vanishing points of said 
lines . 

^21. An obstacle detection method according to any of Claims 
> 17 to 19, 

wherein said feature extraction step extracts a plurality 
of lines, as existing on the plane in the three-dimejnsional 
space and parallel to each other in the three-dimensional space, 
from the images, and determines the inclinations of said lines 
on the images and the vanishing points of said lines. 



^ ^ 22. An obstacle detection method comprising: 

a plurality of image pickup steps of taking the regions. 
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to which light receiving units disposed on a driver ' s own vehicle 
at a substantial spacing from each other are directed^ 
simultaneously as images; 

an image storage step of storing the images taken by said 
image pickup steps; 

a feature extraction step of extracting such ones of the 
regions taken by said image pickup steps as correspond to 
parallel members disposed generally in parallel with each other 
on a plane, as can be traveled by said own vehicle, from the 
first image taken by said first image pickup step and the second 
image taken by said second image pickup step, as stored in said 
image storage step, to determine a point of intersection at 
which said extracted regions intersect in said first and second 
images; 

a difference detection step of determining the 
corresponding region in the second image, as corresponding to 
an arbitrary region in said first image, assuming that said 
arbitrary region is caused by said plane, from the epipolar 
constraint to hold between said extracted region and said first 
and second images, to compare the intensities of said arbitrary 
region and said corresponding region, thereby to extract the 
region having a substantially different intensity as an obstacle 
region to obtain an obstacle region image from the extracted 
result; and 

a height computation step of extracting a polygonal region. 
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as composed of an intensity higher than a standard value, of 
said obstacle region image thereby to detect as a true obstacle 
region said polygonal region of a threshold or higher value 
of the ratio which is determined from the vertical size of said 
polygonal region in said obstacle region image and the size 
from the lower end of said polygonal region to the scan-line 
in said obstacle region image including said intersection point • 

^ 23, An obstacle detection method comprising: 

a plurality of image pickup steps of talcing the regions^ 
to which the light receiving units disposed at a substantial 
spacing from each other are directed, simultaneously as images; 

an image storage step of storing the images taken by said 
image pickup steps; 

a difference detection step of determining the 
corresponding region in the second image, as corresponding to 
an arbitrary region in said first image, assuming that said 
arbitrary region is caused by a plane in a three-dimensional 
space, to compare the intensities of said arbitrary region and 
said corresponding region, thereby to extract the region having 
a substantially different intensity as an obstacle region to 
obtain an obstacle region image from the extracted result; and 
a height computation step of extracting a polygonal region, 
as composed of an intensity higher than a standard value, of 
said obstacle region image thereby to detect as a true obstacle 



108 



region said polygonal region of a threshold or higher value 
of the ratio which is determined from the vertical size of said 
polygonal region in said obstacle region image and the size 
from the lower end of said polygonal region to the scan-line 
set in said obstacle region image. 

24. An obstacle detection method comprising: 

a first image pickup step and a second image pickup step 
of obtaining a first image information of a first image and 
a second image information of a second image, respectively, 
by taking the surrounding region of a driver's own vehicle 
substantially simultaneously as images formed of a set of pixels 
from light receiving units arranged at a spacing on the own 
vehicle; 

an image information storage step of storing said first 
image information and said second image information; 

an intensity difference image forming step of forming 
an intensity difference image by determining the corresponding 
pixels in said second image of the second image information, 
as assuming that an arbitrary pixel of said first image of said 
first image information stored in said image information storage 
step exists on the ground plane being traveled by said own vehicle , 
to determine the intensity difference between said arbitrary 
pixel and said corresponding pixel; 

a discrimination image forming step of obtaining a 



109 



discrimination image by discriminating each pixel in said 
intensity difference image into a pixel having an intensity 
difference no less than a standard value and a pixel having 
an intensity difference less than the standard value; and 

a decision step of detecting and deciding a region having 
a generally wedge-shaped set of pixels in said discrimination 
image as an obstacle region. 

25 • An obstacle detection method according to Claim 24, 

wherein said detection step decides that the lowermost 
pixel in said wedge-shaped region of said discrimination image 
is either at a point of contact between said obstacle region 
in said first or second image, as corresponding to said 
discrimination image, and the ground being traveled by said 
own vehicle, or at a portion of said obstacle region and the 
closest to said own vehicle. 

26. An obstacle detection method according to Claim 24 or 
25, 

wherein said detection step decides that such one of said 
generally wedge-shaped region existing generally in the 
scan-line direction of said first and second images, as 
corresponding to said discrimination image, that its side is 
at a higher location of said first and second images than the 
apexes opposed thereto, is the obstacle region. 



27 • An obstacle detection method according to Claim 24, 

wherein said detection step decides one pair of 
wedge-shaped regions generally of the same shape, as located 
at a spacing on the generally identical scan-line in said 
discrimination image, and decides the region between said paired 
wedge-shaped regions as the obstacle. 

28. An obstacle detection method comprising: 

an image input step of inputting and storing at least 
two images of different pickup points ; 

a feature extraction step of extracting a projected point 
of a motion of an object, as stands still or moves on a plane 
in a three-dimensional space with respect to the pickup point 
of a standard image, upon said standard image corresponding 
to an infinite point, by employing one of the images stored 
by said image input step as said standard image and the other 
as a reference image; 

a detection step of calculating a corresponding point 
on said reference image when it is assximed that an arbitrary 
point on said standard image is on said plane, to detect a point 
non-existing on said plane from the intens ity difference between 
said arbitrary point and said corresponding point; and 

a contact time computation step of computing the time 
period for the point non-existing on said plane to come to the 



taken point of said standard image, on the basis of the point 
non-existing on said plane in said standard image detected by 
said detection step and said projected point extracted from 
said feature extraction step. 

29. An obstacle detection method according to Claim 28, 
wherein said contact time computation step computes the 

time period for the point on the boundary with said plane to 
come to the taken point of said standard image^ on the basis 
of such ones of the points detected by said detection step but 
not existing on said plane, as are located on the boundary line 
with said plane in said standard image and are extracted as 
said projected point by said feature extraction step. 

30. An. obstacle detection method according to Claim 28 or 
29, 

wherein said feature extraction step extracts a plurality 
of lines aligned to the direction of the motion of an object 
which stands still or moves on said plane relative to the pickup 
point of said standard image, to employ the point of intersection 
of the extracted lines, as said projected point. 

31. An obstacle detection method according to any Claims 28 
to 30, 

wherein said images are unknown on the relative locations 
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and positions of their pickup points and on their focal lengths 
and principal points • 

32- An obstacle detection method according to any of Claims 
28 to 31, 

wherein said detection step computes the corresponding 
point on said reference image when the arbitrary point on said 
standard image is assumed to be on said plane, to detect said 
non-existing point from a similarity of the surrounding 
intensities of said arbitrary point and said corresponding 
point • 
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